Skip to content

Stamp verdict flips and failure reasons on health-check telemetry - #1835

Merged
RhysSullivan merged 4 commits into
mainfrom
health-flip-telemetry
Aug 29, 2026
Merged

Stamp verdict flips and failure reasons on health-check telemetry#1835
RhysSullivan merged 4 commits into
mainfrom
health-flip-telemetry

Conversation

@RhysSullivan

Copy link
Copy Markdown
Collaborator

The health span (executor.connection.health.check) records the verdict but not what it replaced, so flapping — a connection oscillating between healthy and degraded — is only visible by diffing consecutive spans per connection. It also collapses very different failures (a probe timeout, a refused token refresh, a failed tool sync) into one degraded label, with the cause only in free text that never reaches telemetry.

  • Add executor.health.previous_status and executor.health.changed to the health span: the verdict this check replaced, read from the row before probing. A first-ever verdict stamps neither.
  • Add an optional enumerable reason to HealthCheckResult (credential_missing, credential_refresh_rejected, probe_timeout, probe_failed, upstream_status, tool_sync_failed), populated at every non-healthy verdict production site (core credential fold, dead-grant verdict, tool-sync stamp, MCP / OpenAPI / GraphQL probes) and stamped as executor.health.reason. Free-text detail still never goes on a span.
  • Carry a structural timedOut marker on McpToolDiscoveryError so a slow-but-alive server classifies as probe_timeout without string-matching the message.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 29, 2026

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Updated (UTC)
✅ Deployment successful!
View logs
executor-cloud 4ed2784 Aug 29 2026, 06:50 AM

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 29, 2026

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
executor-marketing 4ed2784 Commit Preview URL

Branch Preview URL
Aug 29 2026, 06:50 AM

@github-actions

github-actions Bot commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

Cloudflare preview

Torn down — the PR is closed.

@pkg-pr-new

pkg-pr-new Bot commented Aug 29, 2026

Copy link
Copy Markdown

Open in StackBlitz

@executor-js/cli

npm i https://pkg.pr.new/@executor-js/cli@1835

@executor-js/config

npm i https://pkg.pr.new/@executor-js/config@1835

@executor-js/execution

npm i https://pkg.pr.new/@executor-js/execution@1835

@executor-js/sdk

npm i https://pkg.pr.new/@executor-js/sdk@1835

@executor-js/codemode-core

npm i https://pkg.pr.new/@executor-js/codemode-core@1835

@executor-js/runtime-quickjs

npm i https://pkg.pr.new/@executor-js/runtime-quickjs@1835

@executor-js/plugin-file-secrets

npm i https://pkg.pr.new/@executor-js/plugin-file-secrets@1835

@executor-js/plugin-graphql

npm i https://pkg.pr.new/@executor-js/plugin-graphql@1835

@executor-js/plugin-keychain

npm i https://pkg.pr.new/@executor-js/plugin-keychain@1835

@executor-js/plugin-mcp

npm i https://pkg.pr.new/@executor-js/plugin-mcp@1835

@executor-js/plugin-onepassword

npm i https://pkg.pr.new/@executor-js/plugin-onepassword@1835

@executor-js/plugin-openapi

npm i https://pkg.pr.new/@executor-js/plugin-openapi@1835

executor

npm i https://pkg.pr.new/executor@1835

commit: 4ed2784

@RhysSullivan
RhysSullivan marked this pull request as ready for review August 29, 2026 06:59
@RhysSullivan
RhysSullivan merged commit 0221a0d into main Aug 29, 2026
44 checks passed
@RhysSullivan
RhysSullivan deleted the health-flip-telemetry branch August 29, 2026 06:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant